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ABSTRACT 

Of the many issues facing higher education, perhaps 
none has treen acre frequently and hotly debated by college 
administrators, instructors, and students, than the issue of college 
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‘grades. Specifically, faculty and students views on: (1) The 
importance of twelve possible uses of grades in d¥fferent 
instructional ‘settings (courses in students" major area of 
concentration versus ncn-major aNeas of concentration); (2) The 
acceptabilAty cf each of the five common grading systems for 
accomplis¥ing twelve possible uses of grades; and (3) The effects of 
each of ffve common greding-systems on a variety of course outcomes 
(for example, maintaining academic standards and maximizing amount of. 
learning)& Overall, the results strengly support.the belief that 
faculty and students are. in favor of a criterion-referenced grading 
systeg. While the results cannot be generalized to other 
institutions, several innovations in the research design should 
_provide- guidelines for researchers to enable them to conduct better 
studies cn grading in their own institutions. (Author/MV) 
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Abstract 


‘ 
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Of the mary issues fecing Higher Edvcatica, perhaps none has 
been more frequently and hotly debated by; college administrators, 
~instructors, and stuceuts, than the issue of college grading pur- 


poses and practices. Regretably, much of the research to date 
has been poorly done and hence has lead to few changes. The pur- 
» . ‘ . A 
“pose of this research Was to overcone many of the past-deficiencics 
te Be . 


and. provide a cemprehcngdive study of faculty and ‘studenté views 


concerning ‘the uses of grading. in several instructtor2] settings, 


‘and the appropriateness gf a'vardety of comtonly used grading sys- 
tems for accomplishing intended uses of grades. Overall, the re- 


e 
sults strongly ‘support the belief that faculty and students are 


© 


in fevor of a cr#t@rton-referenced grading system. While: the results 
\ ow : ar ; a“ 
cannot be generalfze¢e to other, institutions, several innovations in 


the research design should provide guidelines for researchers to 


enable’ then to conduct better studies on grading in their own insti- 
% 
tutions. 5 . 
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A Comparative Study of Faculty and Student Attitudes Toward 
A Variety of College Grading Purposes and Practices! »2 
? 


Ronald K. Hambleton 
University of Massachusetts, Amherst 


and 
John Murray 
Boston State Colieve 

The issue of college grading practices has been frequently Schone 
among college administrators, instructors, and students. That the issue 
is an important one is clear when one recognizes that grades directly 
affect the career choices of ase students (Baucon, 1974; Stevens, 1973; 
Warren, 1971). In addition, there is substantial evidence to suggest 
that college grading practices affect student attitudes toward learning, 
the amount of Laaendads course selections, and the amount of time spent in 
study (Warren, 1971). : 

Unfortunately though, because of the complexity of the college 
grading practices issue, and the inexperience of most college adminis- 
sorte and instructors in the areas of test development and cducational] 
measurement, considerable confusion exists about proper grading practices. 
Contributing to the shelisinie isa plethora of research studies that have 
only limited pencralizability and/or have been rather narrowly focused 
“on the topics of symbolic representation of grades, notational systems, 


° 


and the use of grades for prediction. Also, on the most important ques- 
tion, that dipeerrtae the purposes or uses of grades, there has assess 
limited research. In recent papers, both Hambleton and Rovinelli (in 
press) and Williams and Miller (1973) have stressed the Leeidtian of addcres- 


sing the uses of grading as a first step in a general plan for comprehensive 


r 
study of collese grading purposes and practices. 


FY paper presented at the annual meeting of ‘NCME, New York, 1977. 
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The research described in this paper was designed to compare faculty 
and students’ views on the following questions: 
1, What is the importance of twelve possible uses of grades in dif- 
ferent instructional settings (courses in students’ major area of 


concentration versus nen-major areas of concentration)? 


2. What is the acceptability of each of five common grading systens for 
accomplishing twelve possible uses of grades? 


3. What are the effects of each of five common grading systems on a 
variety of course outcomes (for example, maintaining academic 
standards and maximizing amount of learning)? 

This research project was designed to respond to several shortcomings 
of many earlier studies. First, researchers have seldom considered the 
dimension of "instructional setting" in their work. It is possible that 
instructors’ and students’ views of the uses of grades and appropriate 
apeitae systems will vary from one instructional setting to another. Second, 
too often researchers have compared one grading system with another without 
regard for the intended uses of grades in a particular instructional setting. 
It is important to study the merits of different grading systems against 

" some very diffetent (and common) uses of grades, and many important course 


’ 


outcomes. Corresponding to each intended use or-purpose of grading are 
appropriate methods of test design and grading. The value of difrerent 
grading systems is situatica-specific--changye the intended use or purpose 
of grades and the merits of different grading systems will also shift. 
Finally, it is important to consider both faculty and students’ views. 

® 
The ideal grading system would be one that was responsive to the intended 


purposes or us¢cs of grades in a particular course and was ‘seen as appropriate 


by both faculty and students. 
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Method 
Instrumentation 


Data for the study were collected from the administration of two ques- 
tionnaires (one desiyned for faculty members and the other one designed for 
Students). The two questicnnaires were essentially identical, differing 
only in the background questions that were asked of faculty members and 
Students. ‘le took about 40 minutes to complete. In an attempt to obtain 
high return rates, the purposes of the study were carefully explained to 
faculty and students. Also, the potential policy implications of the results. 
were stressed. 

The questionnaires were divided into four parts.! The four parts will 
be discussed ext. (Copies of the questionnaires may be obtained by writing 


; ) 
the senior author and enclosing a stamped and self-addressed envelope.) 


Part A—Backyvround 

This section differed for faculty and students. Background questions 
for the faculty members included questions about their age, rank, sex, years 
of teaching experiencé, types of classes taught, and primary teaching area. 
Students were asked questions concerning their sex, age, student status, 
grades in college, SAT scores, experience with P/F grading, major area of con- 


é 


and future plans. 


‘centration, 


Part B—Uses of Grades in Different Instructional Settings 


In this section, faculty and students were asked to complete the 
following task: 


Many uses of srades have been suppested and some uses are more 
important than others_in sone types of courses and with certain 


lactually there were two other parts of the questionnaire: One that was 
designed to permit us to study the factors,affecting grades in six different 
instructional settun.s. The other part cobsisted of a series of open-ended 
questions about wradiny. This part provided faculty and students with an 
opportunity to indicate additional comments. The data derived from these 
two partSare reportcd in Murray (1977). 
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types of students. For example, an instructor may view the uses 

; of grades differently for students taking courses in their major 
area of concentration than for students taking an elective course 
in an area different from their major area of concentration. 


Below are listed 12 uses of grades and two types of instruc- 
tional settings: Students taking courses in thefr major area of 
concentration, and non-mgjor areas of concentration, respectively. 
Your task is to indicate how important you feel each use of 
grades is in each instructional setting. There are four possible 
ratings: : 


l=very important, 2=important, 3=somewhat important, 4=not important. 
Under investigation are the following twelve uses of grades: , 


1. Motivate students to do yood work in the course. 

2. Provide instructors with information about student progress. 

3. Improve a student's ability to critically assess his or her 
own work. 

4.. Provide instructors with information about their teaching 
methods. 

5. Provide instructors with information about their curriculum. 

6. Assess teacher competence. 

7. Rank students on their performance in the course. | ‘ 

8. Inform others (e.¢., advisors, future teachers, employers, 
registrar) about student performance. 

9. Compare student perf rmince against absolute standards of 
performance. 

10. Summarize,multiple evaluations of a student during a course 
into a single digit or letter. * ‘ @ 

11. Provide students with feedback on their course performance. 

12. Provide a method for maintaining academic standards. 


The twelve uses were generated from a review of many past shades on 
2 ; 


grading practices (Ericksen & Bluestone, 1921; Hunt, 1972; Karlins, Kaplan, 


& Stuart, 1969; Scriven, 1976; Warren,-1971). 


Part C-Relative Merits of Different Methods of Grading 

Five grading systems were sclected for investigation: Pass/Fail, 
Pass/No Record, Honors/Pass/Fail, Norm-referenced Grading, Criterion- 
” referenced Grading. The last (criterion-referenced grading) is perhaps the 
Jeast known among ier Pie, but it is current ly attracting considerable 
attention from iuaurienae? at all l-vels of education. Test construction 


and test score interpretations of criterion-referenced tests have been 


- . 
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discussed by many researchers (see, for example, Hambleton & Novick, 


1973; Millman, 1974). 


The five grading systems were~introduced to faculty and students with 
the following dekintttons: 
Pass/Fail 


In this grading system, fhe student either passes or fails 
a course. For a passing grade, the student receives credit 
toward graduation. For a failing grade, the student receives 
| no credit toward graduation and a failing grade on his/her 
transcript. 


Pass/No Record 


This grading system is similar to Pass/Fail except that. 
failing grades are not recorded on a student's transcript. 
When a student fails a course, there will be no record that 
the student had even been enrolled in the course. 


Honors/Pass/Fail é: 


‘The grading system is similar to Pass/Fail grading except 
that among passing students a distinction is made between 
"superior" and "passing" performance. 5 


Jeoacey ferences Grading (Grading on the Curve) 


In this grading system.letters A, B, C, D, and F (or some 
variation) are used to designate the relative performance of 
Students. Letter grades are assigned to reflect Student per- 
formance with respect to the performance of other studencs in 

» the course. 


" Criterion-referenced Grading 


In this grading system, letters A, B, C, D, and F (or some 
variation) are used to designate different levels of course 
performance. The “Tetter grades are assumed to reflect differ-. 
ent levels of performance in some absolute sense.. Grades are 
assigned to students to reflect their level of performance. 

The important point is that each student is judged on his or 

her own merits with respect to the standards sect by the instruc- 
tor and not with si tothe performance of other students in 
the class. 


These five grading systems are among the most commen.in use today. Several, 


other less common rrading systems were identificd\ (for example, anecdotal records 


and Honors/Pass/Xo Record) but they were excluded tO ir the rating task in 


Lard 
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this, and other parts of the questionnaire, 
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more manageable,- As it was, 


this part of the questionnaire required respondents to make 60 ratings. 


The task was for faculty members and students to rate ¢he accept- 


ability (l=highly acceptable, 2=acceptable, 3=minimally acct ptable, 4= 


Whacceptable) of each of the five grading systems for accom, lishing eaclf 


of the twelve uses of grades. 


Part D-Effects of Different Grading Svstems 
on Various Course Ourcanes 


& 


The effects of grading on various‘ course outcomes have been a fre- 


quent topic of study (for example, Hales, Bain, & Rand, 1973; Hambleton 


and Rovinelli, 1976; Karlins, et al., 1°69; Reiner & Jung, 1972; Stallings 


& Smock, 


studies, we identified a list of thirteen course outcomes hat have often 


1971; Stallings, Wolff & Maehr, 1969). From thes_ 


e 


been discussed as important: 


1. 
2. 
3. 


Minimize 
Maximize 
Maximize 


- Minimize 


Maximize 


Minimize 


student competition 
student enthusiasm 
student performance 
cheating 

outside reading 


+ Develop posi:ive self-image 


course dropouts 


Provide data for course evaluation 


» Maintain 
« Maximize 


Maximize 


. Maximize 
- Maximize 


academic standards 

class attendance 

expressions of personal opinions 
amount of learning 

opportunity for further study. 


' 
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and other 


There -were chres tasks for faculty members and students: 


1. Indicate the senties systems which they felt were most 1tkely 
to help accomplish aes Course outcome. 


2. Indicate the grading systems which they felt were most likely to 
aiket lors with the accomplishment of each courseoutcome. 


3. a the course outcomes that were important in Phele courses. 


8 
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Sample F 


- All faculty members of the School of Education at the University of 
Massachusetts were asked to participate in the study. The return rate of 


questionnaires was 77% (75 of 98). A random sample of faculty members jin othér 


parts of the University was also drawn. The return rate of questionnaires from 
this group was 39% (only 29 of 75). In addition,owe selected (at random) 


ten School of Education and ten University courses in which to administer ‘ 


is 
the student questionnaires. Several of the courses selected were not available 


to us and go they’ were replaced by alternate courses. -Students in the selected | 


‘ 


courses were asked to complete the questionnaires at home and return them. 
— ¢ 
The return of questionnaires among students was approximately 507%. 


The data were collected in the Spring and Fall of 1976. . | 


Results and Discussion 


Introduction . ; ° 


. 


This particular research project was designed to provide data for 


administration, faculty, and students in the School of Education at the 


‘ ; r 
University of Massachusetts, Amherst. The data will be used to assfst them 


0 6 Capeenemeecenenes 


. in developing new grading systems; grading systems that reflect the educa- 


tional philosophy of the School.’ However, for our purposes here, we will 


discuss the results obtained from faculty members and students in both 


the School of Education and other parts of tte University. cs 


Background 


Faculty and student responses to the background questions are sum-_ 


marized in Tables 1 and 2. With respect to the’ faculty, 74% were malted; 
/ 


"the majority of the faculty (again, 74%) were in the age range ina to 


50; 85% had four ér more years of eoldege beasheing sci naass se 50% 


of the faculty EaHene both nina ‘and wienesiodes courses, by ved ‘the 
faculty taught only sendiutis ceciaaie, and the remaining 25% taught only 


undergraduates; roughly 1/3 of the faculty were in each of three’ academic - 
a 
rank (Assistant, Associate, Full); and a somewhat surprising ys of the 


faculty felt “knowledgeable about methods for assigning grades to students." 
. 4 . 


7 ‘ 
With respect to’the students, 66% of the ¢tudents were female; 


85% were in the age range 19-27; 23% of the students were freshmen or 


sophomores, 56% were juniors or seniors, and the ‘remaining 21% were grad- 
ga ‘ 


uate students and special students; and over 60% of the students had had 


“ 


some experience with pass/fail grading. Some additional background 


Statistics are also reported in Table 2. 


Importance of 12 Possible Uses of Grades in 
Different Indtructional Settings 


Reported in Table 3 are the means and standard deviations of fachlty 
and student rominge of the dupavetacs of 12 possible uses of grades in courses in 
students’ major areas of concentration. Surprisingly, these ratings were ‘ 
nearly ‘ideritical with faculty and atudent vacingy in courses in students' 
non-major areas of concentration. ' htiiaietatie they are not’ reported Peet! 
Apparently faculty and svadewes made no‘distinctions among different uses 
of grading in students’ major and non-major areas of concentrations. 


Several statistical methods are available for analyzing the data 


reported in Table 3. For example, we could have done a multivariate 


10 


Ms Table 1 i % | ~ . 
| 


Background Informat {pn on School of Education and 
Non-School of: Education Faculty 


J be é e . 
. i ES 
; : ry sei . 
Ruestions ; Education Non-Fducdétion - Total 
. a : (N=75) (N=29) ~ (Ne104) \ 
° , e ij od %, . 
1, What is your,sex? : md 
, (1) Male |, 4.7 - 71.4 73.8. ann 
: (2) Female . » © 2533" 28.6 26.2 « 
: 4 - Pad, peo o ee »§ 
2. What is your’ age? ’ a * 
(1) 21-30 . 9.3 10.7 9.7 
(2) 31-40 te ? : 40.0 42.9 ~ 40,8 
, 43) 41-50 34.7 28.6 , 33.0 e 
~ (4) 51-60 13.3 7.1 11,7 
(5) over 60 2.7 10.7 4.9 ' i? 
® 
© -y2=3.7,  p=.45 ‘t 
: . ; en r 7 | 
- : 3. How many vears of experience have you é : Fs 
» had as a member of a university fac- m 3@ v 2 ‘ 
ulty? mem, 
.Q) 0-3 years, sa _ 20.0 teh - 15.4. E 
7 (2) 4-6 years 17.3 : 34.5, 22.1. wD 
‘ (3) 7-9 years , 22.7. %.9 13.3°, . 2 
* (4) 10-12 years - 13.37 13.8 13.5 << wl 
(5) over 12 years ‘26.7 _, 4le4 30.8 2 
te x7"10.8, ps.05 °° Y aes 
. _ & What types of olasses do you teach? ° Pace: f cA . : 
oe . Lan ‘ . .* 
ee an * (1) mainly’ graduate level (fsx “and 33.3: 3.6 35-2 ‘ ee 
‘ over) 7 Shey we ; ° 96.9 vo 
4 (2) mainly undergradcuate-level (75% 22.7 - 95.7 BS iy : : 
. and over) as re ae ‘ S| “| 
(3) a mixture of graduate-level and 44.0 60.7 - 3 ee. ° 
underpraduate-level (26-742) ° z eK ! 
1 : . om) 
2 < aoe 
; x*9.7, p<.01" Me ng 
cm ci in i i ee nin NT " r 


Table ‘1 (cont) 


-+—---- Cr CO Orr renee a 
. n Faculty 
Ruastions * Education Non-FEducation Total 
(N=75) (N=29) (i= 104) 
> * . 
5. What t¢ your faculty rank? 7 
(1) ‘Lecturer 6.8 10.7 7.9 
(2) Assistant Prdtessor 34,2 32.1 33.7 
(3) Associite Professor 34.2 25.0 Sisal 
_ (4) Professor . : 24.7. 32.1 26.7 
wk : , y7=1.4, p=.71 
7. To what extent do you feel knowledse- 
able about methods for assisning 
grades,t6 students? : . ' 
* (1) To a great extent *40.0 29.6 37.3 
(2) To'a considerable extent » 61,3 59.3 46.1 
(3) To a limited extent a 16.0 ll. 14.7 
(4) Not at all 207 Oe v.0 2.0 
793.0, p¥.39 : 
# 8, Would you te interested in attending 
workshops tq discygh the issue of | : 
college grading pricticesd ey" 
(1) Definitely yes | ° ee . 15.7 ° yo 74 13.4 
(2) Yes a ; 28.6, 7 22.2 | 26.8 
(3) No . 37.1 40.7 » 38.1 
(4) Unsure ~ ‘ ‘ 18.6 29.6 21.6 
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A. 
Se ees, here : Table 2 
Background Information on School of Education.and 
Won-School of Education Students 

Students 
Questions Educat fon Non-Fducation Total 
(Ne113) (N@336) (N=449) 


se ree 


1. What ie your sex? 


(1) male 29.7 35.8 34.3 
(2) female 70.3 64.2 65.7 
xel.1, pe.29 ’ 


2. What is your age? 


(1) 18 and under % 3.6 2.9 
(2) 19-21 46.0 $9.7 56.3 . 
(3) 22-24 15.0 19,1 18.1 . 
(4) 25-27 15.9 8.4 10.3 
(5) 28-30 71 5.4 5.8 
(6) over 30 “15.0 3.0 6.7 
x7#26.5, p<.001 , 
3. What is your student classification? . 
(1) Freshran or sophvore 14,2 25.9 22.9 
(2) Junior or sentor 46.9 58.6 $5.7 
(3) First vear graduate student 11,5 4.2 6.0 , 
(4) Advanecd-level pracsuate stucent 21.2 $.1 ‘ 9.1 
(5) Special student 6.2 6.3 6.2 


7239.0, p<.001 


4, What is your current prade point average? 


Q)) less than 2.9 
(2) 2.0 - 2.69 
G3) 2.5 - 2.99 
(4) 3.0 - 3,49 
(5) 3.5 - 4.99 
(6) don't revenbder 


x7#11.8, p<.05 


a a eee 
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Table 2 (cont) * 


Quest ions Students 


Education Non-Fducation Total 
(8-113) (N=336) (N=449) 


8 5 
5. What was your SAT verbal score? ; 3 


(1) less than 400 
(2) 400-500 
(3) 501-600 
(4) 601-700 
(5) over 700 
(6) don't remember 2 


795.2, po.39 


6. What was your SAT quantitative score? 


(1) less than 400 

(2) 490-500 1 
(3) 501-600 2 
(4) 601-700 1 
(5) over 700 

(6) don't remenber 3 


7911.4, p<.05 


7. Approximately what percent of your courses 
have been graded - Pass/Fail? 


(1) about 100% 14 
(2) about 806°, 5 
(3) about 60% 9 
(4) about 40° 22 
(5) about 20% 32 
(6) about 0% 16 


x7#138.2, p<.001 


8. How many courses at the University have 
you taken on a Pass/Fail basis? é 


Q) 0 41.1 
(2) 1-3 47.3 
(3) 4-6 8.9 
(4) 7-9 1.8 
(5) 10 or more 0.9 


y7=2.5, pe.64 
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Table 2 (cont) 


Studchts 


Education Non-Fducation Total 
(N=113) (N= 336) (N=449) 


* Questions 


“99, How many courses heve you taken on a 
Pass/Fail basis in the School of Edu- 
cation? 


(1) 0 

(2) 1-3 

(3) 4-6 

(4) 7-9 

(5) 10 cr more 


47173.2, p<.001 


ll. Are you planning to go to graduate 
school? 


(1) definitely 

(2) probably 

(3) uncertain 

(4) probably not 

(5) definitely not 

(6) I an currently in graduate scheol 


x7=41.2, p<.001 


12. Are you planning to go to professional 
school? 


if (1) definitely 
(2) probably 
(3) uncertain 
(4) probably not 
(5) definitely not 
(6) I am currently in a professional 
school 
r 
 y2=22.6, p<. 001 
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Table 3 


Descriptive Statistical Analysts of Faculty and Student Ratings! 
of the Importance of 12 Possible Uses of Grades in Courses 
in Students' Major Areas of Concentration 


ae eee rT Re ee 


Facalty Students 
Gis a BE Bente’ Education  Non-luucation Total Education Non-Education Total 
acs ° (N=75) (5=29) (N=104) | (2113) (82336) (#449) 
R sD X SD R sp] sD xX SD R sD 


? : ° 
Motivate students to do good , 
work in the course A . : ¢ aL} 2 . . . +2 1.0 


Provide instructors with infor- 
mation about student progress A , ‘ * . 3 ‘ 5 s 52. 1.0 


- Improve a student's ability to 
erfitically assess his or her 


Own work « 


Provide instructors with in- 
forrition about their . 4 
teaching methods ‘\ 


Provide instructors.with in- 
formation about their curriculum 


Assess teacher competence 


Rank students on thetr per- 
formance -in the course 


Inform others (e.g., advisors, 
future teachers, erployers, 
registrar) about student per- 
formance 


Compure studene performance 
against absolute standards of 
performance 


» Semrurize muleiple evaluations 
ef a student during a course 
inte®a sinple dipit or letter 


Table 3 (continued) 


Fuculty Students 
Education Non-Education Total Education Non-Education Total 


(N=75) _(N#29) (8104) | (N#113) (N=336) (N=449) 
Uses of Grades X sD X sD X sd| X sD XK sD xX sD 


ll. Provide students with feedback 
on their course performance 


12. Provide a method for maintain— 
ing academic standards 


llevery important, 2=important, 3=somewhat important, 4enot important. 


f F [ 
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analysis of the means or carried out a profile gion 6% purposes, - 
a less sophisticated analysis seemed sufficient. For fa ulty, a difference 


of about .4 was needed between two means for the difference to be statistically 


* significant at the .05 level of confidence. For the students, because of the 


larger sample size, the required difference was about .2. These differences 


were used as guidelines for discussing the observed mean differences. 


Our first observation was the high leyel of agreement between faculty 
2 


and student ratings. The rank order correlation between the two sets of 


mean ratings was about .74. However, students did tend to rate higher than 


faculty the importance of the 12 uses of grades (for 8 of 12 comparisons, 


the students rated the use of grades as more important than the faculty d-d). 


A difference between faculty and students of as much as % point fn the mean 


ratings was obtained for only three of the uses (uses 4, 5, 6). With respect 


to these three uses, students more than faculty tended to feel that it was 


important for grades to provide information about a faculty member's teaching, 


methods, curriculum, and competence. (As an aside we noted that there were 


differences between School of Education and non-school of Education personnel 


C in the overall ratings of the importance of the 12 uses of grading. Generally, 


chool of Education personnel [faculty and students] tended to rate the ‘ 


> 


various uses of grades as less important than théir counterparts.) 


Which uses of grades were seen as the most imporfant? For the faculty, 


the answer was clear (listed in order of importance): 


11. 


& 
Provide students with feedback on their course performance. 


Inform others (e.g., advisors, future teachers, employers, registrar) 
about student performance. 


Motivate students to do good work in the course. 


Provide instructors with information about student progress. 


Improve a student's ability to critically assess his or her own work. 


2) 


. 
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These five uses of grading were rated as signifjeantly more important 3 

tnan the other uses of grades on our list (with the exception of use 12-- 

maintaining academic standards). For the students, the most important uses 

of grades were less clear because of the closeness of afl of the mean 


ratings. Basically though, faculty and students agreed on the most im- 


portant uses of grades. 


Acceptability of Fiye Grading Systems for 
Accomplishing 12 Possible Uses of Grades 


In Table 4 ate reported the percentages of "acceptable ratings" given 
by faculty and students for the five grading systems with respect to the 12 
possible uses of grading. Respondents used a four point rating scale: 


lshighly acceptable, 2=acceptable, 3=minimally acceptable, 4=unacceptable 


. ~ 
An "acceptable rating," for the purposes of this analysis was defincd as a 


My ND" oe "9 tating. . 

Consistent with the earlier reported results, students tended to fate 
the grading systems (regardless of the use) aS more acceptable than the faculty. 
Across the 60 pairs of percentages that could be compared (12 uses of grades E 
x 5 grading systems), the student sareanthae (reflecting acceptability) was 
higher, 55 times. All five exceptions to tis pattern occurred with criterion- 
referenced yrading. Here, faculty rated the merits of criterion-referenced 
grading hi,her (albeit, only slightly higher) than the students. 

The most important comparisons concern the relative merits of the five 
grading systems. For ll of the 12 uses of grades, more faculty found criterion- 
referenced grading to bé acceptable than any other. For students, criterion- 
referenced grading received the highest ratings, 10 of ta 12 times. | 

Next, we did an fndepth analysis of the response data for the five 


uses of grades (1, 2, 3, 8, 11) identified in the last section as the 


21 


Table 4 
Faculty and Student Ratings of the Accepvtability 
of Five Grading Systems for Accomplishing 
12 Possible Uses of Grades 
(Percentage of "Acceptable" Ratings Are Reported) 


— m . 
Faculty Students 
; Grading on P 
Uses of Grades System | Education Non-Education Total Education’ Non-Education Total 
, (N=75) (N229) (N=104) (#113) (N= 336) (N#449) 
(i ag 
1. Motivate students to do good P/F 63.1 63.6 63.2 75.7” 74.6 74.9 
work in the course P/NR 46.2 26.1 40.9 50.5 51.2 50.9 
s H/P/F 90.8 91.7 91.0 95.0 93.4 93.8 
. ERG 63.7 87.5 73.6 78.8 86,8 85.6 js 
CRG 83.6 100.0 88.0 84.2 90.7 89.1 ” 
0 
2. Provide instructors with in- P/F 48.5 38.1 46.0 67.0 60.1 61.9 
formation about student P/KR 39.4 22.7 35.2 56.6 52.7 53.5 
progress H/P/F 86.4 ‘ 60.9 79.8 93.9 90.1 91.0 
NRG 73.1 87.0 76,7 82.8 89,2 87.7 
CRG 91.0 100.0 93.4 89,1 93.0 92,4 ’ 
| é 
3. Improve a student's ability P/F 46.9 36.4 44,2 66.3 | 60.3 61.5 
to critically assess his or P/NR 42.2 26.1 37.9 50.9 ; 32s3 51.8 
, her own work H/P/F 87.5 62.5 70.7 88.0 1 86.3 86.7 
NRG 72.7 83.3 75.6 74,7 88,2 85.0 
CRG 92.4 96.0 * 93.4 » 67,3 89,9 89.3 
! 
44 Provide instructors with in-|* P/F 38.8 23.8 _ 35.2 52.0 58.5 58.7 
information about their P/ER 38.8 > 27.3 36.0 51.0 50.6 50.6 
teaching methods j H/P/F 70.1 * 43.5 63.3 80.0 84.7 83.6 
NRG 61.2 69.6 63.3 76.5 88.5 - 85.6 
CRG 1 83.8 


Table 4 (cont) 


———— 


Faculty Students 
Grading 
System Education Non-Fducation Total Education Non-Fducation Total 


py ; (N#75) m=29) (N#104) (Ne113) (e336) (Ne449) 


_ Uses of Grades 


Provide instructors with in- 
formation about their cur- 
riculum 


Assess teacher competence 


Rank students on their per- 
formance in the coursé 


Inform others (e.g., advi- 
sors, future teachers, en- 
ployers, registrar) about 
student performance 


Compare student performance 
against absolute standards 
of performance 


Table 4 (cont) 


Faculty 


Students 


Grading 
Syste 


Uses of Crades Total 


(N=194) 


Education Non-Education 
(N=75) (X=29) 


Education Non-Fducation Total 
(N#113) (N= 336) (N#449) 


Summarize multiple evaluations 


of ea student during a course in- 47.5 45,7 46,2 

to a single digic or letter 73.7 72.3 1237 
81.8 85.4 B4.6 

85.9 89.1 88.4 

? 

ll. Provide students with feedback 65.0 62.9 63.5 
on their course performance 62.6 56,2 57.9 
86.9 91.0 98.0 

83.7 92,3 90.3 

90,0 92.1 91.6 

12, Provide a wethod for maintaining 62.0 56.7 57.8 


academic standards 
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most important. The chart below summarizes the average percentage (across 


the five most important uses of grades) of “acceptable” ratings given to 


tthe five grading systems by faculty and students: 
2 


Grading System Faculty Students 
P/F 51.4 63.2 
P/NR 39.7 51.0 
H/P/F 82.6 89.7 
NRG 76.6 87.5 
CRG 91.5 90.4 

a 


The chart above a things. One, for the five most 
important uses of grades as dentified by the faculty and students, P/F 
grading and P/NR grading are’ clearly unacceptable alternatives. Two, there 
is not a great deal to choose among the other three as far as the students 
were concerned. Over 87% of the students found al! three grading systems 
at least minimally acceptable. Three, for faculty, CRG was preferred to 
the other two most popular (NRG and H/P/F) by a statistically ‘significant 
margin (p<.05). Perhaps the most surprising result revealed by the chart 


was the "acceptability" of norm-referenced grading to so many students. ' 


Effects of Different Svstems of Grading 


on Various Course Outcomes 
Reported.in Table 5 are the percentages of faculty and students 
rating positive and negative effects of five grading systems on a variety 
of course outcomings. In Table 6 are results that bear on the question of 
the course outcomes that faculty and students consider to be most important. 
Which grading systems were rated by faculty and students as most 


likely "to help" or "to hinder" the accomplishment of the course outcomes? 


- 


. ’ 
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Table 5° 


. Effect of Different Systems of Grading 
on Various Course Outcomes 


Faculty Students , 


Course Outcomes Education Non-Education Total 


(N=113) (Ne 336) (N2#449) i 


Total 
(N2104) 


Iducation Non-Education 


l. Minimize student 
competition 


H/P/NR 37.2 39.0 38.5 
19.5 1239 14.5 
P/NR 72.6 71.9 71.9 
4.4 5.7 5.4 4 
nN 
NRG - 8.0 8.1 8.1 : 
73.2 71.3 71-8 
CRG 23.9 23.7 23.9 
39.8 42,5 41.7 
2, Maximize student P/F 31.9 16,6 20.4 
enthusiasn 26.5 37.3 34.5 ‘ 
H/P/NR 52.2 45.0 46.8 
11.5 14,1 13.4 
P/NR 25.7 20.7 21.9 
38.9 472 45.2 
NRG 28.3 37.8 35.3 
38.9 24.9 28.4 


CRG 


Table 5 (contd) 


; Faculty | Students 
Course futcomes =~ Education Non-Education: Total Education Non-Education Total 
: (N=75) (N=29) (Ne1Q4) | (Ne113) (N=336) (N#449) 


3. Maximize student 9.0 


; , 23.0 : 
performance : ‘18 : 5 32,4 48,8 


Table 5 (contd) 


Faculty Students 


, Course Outcomes Education Non-Education Total Education Non-Education Total 
(N=75) (N=29) : (Ne#194) (N#113) (N= 336) (N=449) 


5. Maximize outside 
reading 


6. Develop positive 
self—image 
H/P/NR 


P/NR 


NRG 


7. Minimize cours 
dropouts ' 
¢ 


8. Provide data for 
course evaluation 


.| System 


Grading 


. 


Effect 
"+" or "=") 


Faculty 


Education Non-Education 
(N=75) (N=29) 


Total 
(N#104) 


Students 


Education Non-Education 
(N=113) (N=336) 


71 5.4 
38.9 45,2 
8.8 6,0 
67.3 75.4 
10.6 bee 
e r 
10.6 10.5 
54.9 52.7 
21.2 15.0 
36.3 52.4 
zi.2 13.8 


Total 
(Ne449) 
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Table 5 (contd) 


. F. Students 
Grading Effect acully 


Course Outcomes System |.:("+" or "=") | Education Non-Education Total Education Non-Education Total 
(N=75) (N=29) ° 9 (N-104) (N=113) (N=336) (N#449) 5 


9. Maintain academic P/F 
etandards 


H/P/NR 


10. Maximize class 
attendance 


Table $ (eontd) 


Paculty Students 


Course Outcones Education MNon-Education Total Education Non-Education Total 
(x=75) (N=29) (Ke194) (N*113) (N= 336) (Ne449) 


11, Maminize fre 
stones of Sersonal 


sata 


Table 5 (contd) 


Grading Faculty Students 


Course Outcomes System - Education Non-Education Total |* Education Non-Education Total 
(N#75) (N=29) (Ne1N4)* | (Ne113) (N=336) (N=449) 


13, Maxinize oppor- P/F 
tunity for fur= 
ther study 


H/P/NR 


P/NR 


NRG 


Table 6 


Percentage of Faculty and Students Indicating 
the Importance of Various Course Outcomes 


Faculty ; Students 
Course Outcomes Education Non-education Total Education Non-education Total 
(N53) (N=24) (N=77) (N=51) (N#258) (N=309) 


4 


Minimize student competition 34 27 28 
Maximize student enthusiasm 98 ‘ 77 80 
Maximize student performance ‘ 94 79 82 
Minimize cheating 29 20 22 
Maximize outside reading ; 71 51 : 54 


Develop positive self-image 91 F 75 


Minimize course dropouts . 17 11 


Provide data for course 
evaluation ; 13 20 


Maintain acadenic standards 47 41 
Maximize class attendance 41 27 
Maximize expressions of 

personal opinions i 79 61 
Maximize amount of learning 98 


Maximize opportunity for 
further study 71 
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The most significant results are summarized below: 


—Grading Systems Which— 


» Course Outcome Help Hinder 
1. Minimize student competition P/F, P/NR : NRG 
. 2. Maximize student enthusiasm H/P/F, CRG 4 P/NR 
3. Maximize student performance CRG : P/NR 
4. Minimize cheating P/F, P/NR NRG, CRG 
5. Maximize outside reading : H/P/F, CRG P/NR 
6. Develcp positive self-image _ H/P/F, CRG 
7. Minimize course dropouts P/F, P/NR NRG, CRG 
8. Provide data for coutea evaluation CRG P/NR 
9, Maintain academic standards CRG P/NR 
10. Maximize class attendance CRG, NRG P/NR 
ll. Maximize expressions of ‘ 
personal opinions H/P/F, P/NR 
12. Maximize amount of learning CRG P/NR 


13. Maximize sananeies for 
' further study H/P/F, CRG : ° 
_Of course, there were some differences in the ratings of faculty and 
students, but the above: summary essentially "captures" the feelings of both 
groups. . 
Next, we conducted an analysis of the response data for the three 
: » 
most important course outcomes (2, 3, 12) revealed by Table fi. These are: 
2. Maximize student enthusiasm 


3. Maximize student performance 


12. Maximize amount of learning. 
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The chart below summarizes the average percentage (across the three most 
important course outcomes) of "+" and "-" effects ascribed to the five 


grading systems by faculty and students: 


Grading System Effect Faculty Students 
P/F + 11.6 16.9 
H/P/F + 27.7 41.7 
P/NR + 15.1 17.9 
NRG + 17.7 29.8 
CRG + 48.6 54.4 
P/F - 20.9 36.9 

_ H/P/F - 6.1 14.3 
P/NR - 36.1 52.8 
NRG - 26.8 22.9 
CRG - 9.0 16.2: 


The chart above leads to this conclusion: Across the three most 
important course outcomes as identified by faculty and students, criterion- 
‘referenced grading and honors, pass, fail grading were seen as the most 
desirable and pass/fail grading and pass/no record were seen as the least 


desirable. 


Coneliisten 
The controversy over — purposes and practices in Higher 

Education will not subside until institutions approach the study of the 
problem in a more systematic way. While we do not intend to offer a compre- 
hensive ‘alan for studying the problem of grading purposes and practices in 
this paper (see Hambleton & Rovinelli, in press), several of the activities 
outlined in this paper would be part of any comprehensive plan. The views 
of faculty and students tqward a variety of cenieed or uses of grades in 


different instructional settings should be considered. Second, ‘the relative 


merits of possible grading systems for accomplishing the most important of 
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the uses of grades in a particular institution should be studied. How 
faculty and student data will be used in any institution will depend on 


the types of flexibility in grading practices that are possible. ‘Finally, 


the relative effects of different grading systems on various course out- 


comes should be considered. Of counse, the above steps are three of many 
that need to be considered im developing a college grading policy. 

While the results from this study cannot be generalized to other 
institutions, we feel that the study provides some useful guidelines for 
conducting grading research studies. Three major shortcomings of many 
previous wiuadeiton grading were overcome. First, there was recognition 
of the fact that there aie Gi uses of grades, and the importance of each 
use of grades will sometimes depend on the particular instructional setting. 
It is inappropriate to ask individuals about what they believe to be the 
most important uses of grades without first clearly-specifying the instruc- 
tional setting. In our study, instructional setting was not a significant ' 
factor in faculty and student ratings, but it may be elsewhere. Second, a 
study of the merits of different grading systems should be conducted relative 
to the various possible uses of grades. Finally, a comprehensive review 
of grading purposes and practices should include both faculty and student 
views. ‘ ; é 

The results of this study revealed several things. First, "instruc- 
tional setting" had no effect on the ratings of the importance of 12 common 
uses of grades. Second, five uses of grades were rated as significantly 
more important than others we studied. They were: 


Inform others (e.g., advisors, future teachers, employers, registrar) 
about student performance 


Provide students with feedback on their course performance 


Motivate students to do good work in rile course 
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Provide instructors with information about student progress 


Improve a student's ability to critically assess his or her 
own work. : : 


Three, three course outcomes were viewed by faculty and students 
as more important than others. These were: 

Maximize student enthusiasm 

Maximize student performance 

Maximize amount of learning. 

If an institution were to select a single grading system, it ought 
to choose one that would be acceptable to both faculty and students for 
accomplishing the most important uses of grades. Also, the grading satu 
should have a positive effect on the most important course outcomes. From 
our data, we found that over 90% of faculty and students found eet oertine 


referenced grading to be "at least minimally acceptable." 


No other grading 
system was rated as highly (H/P/F was second best). “With respect to the 
most-important course outcomes, again, criterion-referenced grading was 


rated to be best. Pass/fail grading was considered to be the least 


¢ 


acceptable. This is especially important to us because the School of 


Education is currently using a pass/fail grading system!) 

On the basis of our results, a recommendation to adopt a erties 
referenced grading system would seem reasonable. Still, it is easier said 
than done, for of all the grading systems, criterion-referenced grading 
may be the most difficult system to implement properly. For one, 
criterion-referenced grading requires instructors to specify their course 

_ outcomes in rather specific terms. Second, test development methods 
require careful attention by instructors to be sure that test items measure 
course objectives and that the examinations have content validity. Finally, 
there is the problem of setting "performance standards" to separate "A" 


level performance, from "B" level performance and so on. 
P P 
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